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AN EFFICIENT METHOD FOR FETCHING INSTRUCTIONS HAVING A NON-POWER OF TWO 

SIZE 

TECHNICAL FIELD 

The present invention relates generally to microprocessors, and more particularly, to an efficient method 
5 for fetching instructions having a non-power of two size. 

BACKGROUND ART 

A microprocessor typically includes a cache memory for storing copies of the most recently used 
memory locations. The cache memory generally is smaller and faster than main memory (e.g., disk). A 
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microprocessor also typically includes an instruction prefetch unit that is responsible for prefetching instructions 
for a CPU (Central Processing Unit). In particular, an instruction cache unit is typically organized in a way that 
reduces the amount of time spent transferring instructions having a power of two size into the prefetch unit. For 
example, a 256-bit bus (256 bits = 4 x 8 bytes = 32 bytes) connecting the instruction cache unit and the prefetch 
unit allows a 32-byte instruction prefetch unit to fetch 32 bytes of instruction data in a single cycle of the 



microprocessor. 



15 DISCLOSURE OF INVENTION 

The present invention provides an efficient method for fetching instructions having a non-power of two 
size. For example, the present invention provides a cost-effective and high performance method for an 
instruction fetch unit of a microprocessor that executes instructions having a non-power of two size. 

In one embodiment, a method for fetching instructions having a non-power of two size includes fetching 
20 a first instruction cache line having a power of two size for storage in a first line buffer of an instruction fetch 
unit of a microprocessor, fetching a second instruction cache line having a power of two size for storage in a 
second line buffer of the instruction fetch unit, and extracting and aligning instruction data stored in the first line 
buffer and the second line buffer to provide an instruction having a non-power of two size. 

In one embodiment, a method for fetching instructions having a non-power of two size includes fetching 
25 at least two sequential cache lines of instruction data having a power of two size for storage in dual in-line 

buffers of an instruction fetch unit, and extracting and aligning a non-power of two size instruction that is stored 
in the dual in-line buffers. Specifically, two sequential instruction cache lines each having a power of two size 
(e.g., 32 bytes) are stored in the dual in-line buffers. An instruction having a non-power of two size (e.g., 5 
bytes, 1 0 bytes, 1 5 bytes, or 20 bytes) is extracted and aligned from the dual in-line buffers in a single clock 
30 cycle of the microprocessor. More specifically, an instruction cache line is stored in an instruction cache unit, in 
which the stored instruction cache line is power of two size-aligned. The instruction cache line is fetched and 
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stored in a first line of the dual in-line buffers. Power of two size instruction cache data (e.g., 32 bytes of 
instruction cache data) is extracted from the dual in-line buffers and then transmitted to an instruction aligner. A 
rotate and truncate (RAT) unit of the instruction aligner rotates and truncates the power of two size instn.ct.on 
data to provide an instruction having a non-power of two size, which is then transmitted to an instruction queue 
for buffering before execution. For example, this method can be used for a microprocessor that implements an 
instruction set architecture, which includes instructions having a non-power of two size. 

Other aspects and advantages of the present invention will become apparent from the following detailed 
description and accompanying drawings. 

BRIEF DESCRIPTION OF DRAWINGS 

FIG. 1 is a block diagram of a microprocessor that includes an instruction fetch unit in accordance with 
one embodiment of the present invention. 

FIG. 2 shows various formats of instructions having a non-power of two size. 

FIG. 3 is a block diagram of an instruction queue and the instruction fetch unit of FIG. 1 shown in 
greater detail in accordance with one embodiment of the present invention. 

FIG. 4 is a functional diagram of the instruction cache unit of FIG. 1 connected to the instruction fetch 
unit of FIG. 1 in accordance with one embodiment of the present invention. 

FIG. 5 is a diagram of possible 5-byte instruction positions within a 32-byte wide cache memory. 

FIG. 6 is a functional diagram of the operation of the instruction fetch unit of FIG. 4 shown in greater 
detail in accordance with one embodiment of the present invention. 

FIG. 7 is a functional diagram of a multi-level implementation of the instruction aligner of FIG. 3 in 
accordance with one embodiment of the present invention. 

FIG. 8 is a block diagram of the line buffers connected to the double word muxes of the instruction fetch 
unit of FIG. 6 shown in greater detail in accordance with one embodiment of the present invention. 

FIG. 9 is functional diagram of the operation of the rotate and truncate (RAT) unit of FIG. 6 shown in 
25 greater detail in accordance with one embodiment of the present invention. 

FIG. 10 is a functional diagram of a symbolic implementation of the RAT unit of FIG. 6 in accordance 
with one embodiment of the present invention. 
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FIG. 11 is a functional diagram of a RAT bit ordering in accordance with one embodiment of the 
present invention. 

FIG. 12 is a functional diagram of a RAT physical implementation in accordance with one embodiment 
of the present invention. 

FIG. 13 is a functional diagram of an input byte ordering of each four byte group that allows the mux's 
select control signals to be shared in accordance with one embodiment of the present invention. 

FIG. 14 is ablock diagram of the instruction queue of FIG. 3 shown in greater detail in accordance with 
one embodiment of the present invention. 

MOPES FOR CARRYING OUT THE INVENTION 

A typical instruction set architecture (ISA) for a microprocessor specifies instructions has a power of 
two size, which can be aligned on a power of two boundary in a conventional cache memory. A typical ISA 
includes 32-bit instructions that are a fixed size such as for RISC (Reduced Instruction Set Computer) processors. 
The 32-bit instructions are typically aligned on a 32-bit boundary in a conventional instruction cache unit. The 
32-bit instructions can be prefetched from the instruction cache unit in one clock cycle using a conventional 32- 
bit data path between the prefetch unit and the instruction cache unit. 

However, new instruction set architectures may include instructions having a non-power of two size. To 
efficiently fetch instructions having a non-power of two size, a method in accordance with one embodiment of 
the present invention includes fetching at least two sequential cache lines for storage in line buffers of an 
instruction fetch unit of a microprocessor, and then efficiently extracting and aligning all the bytes of a non- 
power of two size instruction from the line buffers. This approach allows for a standard instruction cache 
architecture, which aligns cache lines on a power of two boundary, to be used. This approach also reduces the 
data path between the instruction cache and the instruction fetch unit. This approach sustains a fetch of always at 
least one sequential instruction per clock cycle of the microprocessor. 

For example, an ISA can require supporting execution of instruction packets such as VLIW (Very Long 
Instruction Word) packets that are either 5, 10, 1 5, or 20 bytes wide. For certain applications such as graphics - 
media code, there may predominantly be 20-byte wide VLIW packets. If a 20-byte VLIW packet is executed 
clock cycle (e.g., at a peak execution rate), then to maintain this peak execution rate, the instruction fetch unit 
fetches at least 20 bytes per clock cycle from the instruction cache unit. 

FIG. 1 is a block diagram of a microprocessor 100 that includes an instruction fetch unit (IFU) 108 in 
accordance with one embodiment of the present invention. In particular, microprocessor 100 includes a main 
memory 102 connected to a bus 1 04, an instruction cache unit 106 connected to bus 104, instruction fetch unit 
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,08 connected to instruction cache unit ,06, and PI processor 1 .0 and P2 processor 1 12 each connected to 
instruction fetch unit 108. In one embodiment, PI processor 1 10 is provided (i.e., instead of PI processor 1 
and P2 processor 1 12), and PI processor 110 is connected to instruction fetch unrt 108. 

in one embodiment, instruction cache unit 106 is a conventional 1 6-kilobyte dual-ported cache that uses 
a well-known (standard) cache architecture of two-way set associative, 32-byte lines (e.g., in order to mmumze 
cost and timing risk). Instruction cache unit 106 returns a new 32-byte cache iine to instruction fetch umt 108 
during each clock cyc.e of microprocessor 100, and thus, instruction cache unit 106 can satisfy an execut.on rate 
of, for example, a 20-byte VLIW packet per clock cycle of microprocessor 100. 

However the 20-byte VLIW packets may not be aligned on the 32-byte cache line boundaries of 
instruction cache unit 106. VLIW packets can start on any byte boundary, and an empirical observat.on reveals 
that a significant number of the VLIW packets often start on a first cache line and continue onto a second cache 
line of two sequential cache lines. For VLIW packets that span two cache lines, two Cock cyc.es would typ.cally 
be needed to fetch the entire VLIW packet before executing the VLIW packet. As a result, the execution p.pehne 
of microprocessor 100 may be reduced to approximately one half, thus resulting in a significant performance 
15 degradation. 

Accordingly, instruction fetch unit 108 stores two instruction cache lines fetched from instruction cache 
unit 106 to ensure that instruction fetch unit ,08 can provide the next VL1W packet, regardless of whether or not 
the VLIW packet spans two cache lines, in a single clock cycle. In particular, instruction fetch umt 108 
prefetches ahead of execution, predicts branch outcomes, and maintains two sequential cache lines of unexecuted 
instructions. For example, a 20-byte VLIW packet is extracted from the two sequential instruction cache Imes of 
instruction fetch unit 1 08 and then appropriately aligned, and the extraction and alignment is completed m one 
clock cycle (assuming the two sequential cache lines stored in instruction fetch unit 1 08 represent valid data^ 
For sequential execution, instruction fetch unit 108 provides at least one VLIW packet per clock cycle, regardless 
of whether or not the VLIW packet spans two cache lines in instruction cache unit 106. 

in one embodiment, instruction cache unit ,06 is a shared instruction cache unit for multiple processors 
(e.g., PI processor 1 10 and P2 processor 1 12). 

A typical instruction fetch unit provides a 4-byte granularity. In contrast, instruction fetch unit ,08 
provides a ,-byte granularity and can fetch instructions with a ,-byte granularity. Instruction fetch un.t ,08 
extracts and aligns a 5, 10, 15, or 20 byte VLIW packet from 64 bytes of instruction data stored in instruction 
fetch unit ,08 (e.g., an instruction cache ,ine of an instruction cache unit ,06 is 32-bytes). ,nstruction fetch umt 
,08 efficiently performs the align operation as discussed below. 
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FIG. 2 shows various formats of instructions having a non-power of two size. In particular, instruction 
fonnat 202 shows an instruction fonnat for a variable size opcode which includes an 8-bit to 16-bit opcode, a 6- 
bit to 10-bit destination, a 6-bit to 10-bit source 1, a 6-bit to 10-bit source 2, and a 6-bit to 10-bit source 3. 
Format 202 ranges from 32 bits to 56 bits. Instruction format 204 shows a 40-bit instruction fonnat which 
includes an 8-bit opcode, an 8-bit destination, an 8 bit source 1, an 8-bit source 2 and an 8-bit source 3. 

Storing non-power of two size instructions, such as shown in instruction format 204, in a conventional 
DRAM (Dynamic Random Access Memory) or other conventional cache memory that includes cache lines of 
power of two size (e.g., because of binary addressing) results in non-aligned instructions being stored in the 
instruction cache. Thus, one embodiment of the present invention allows for the fetching of non-power of two 
size instructions from an instruction cache unit in one clock cycle of the microprocessor. For example, a typical 
DRAM has a width of a power of two number of bits (e.g., 32 bytes). Similarly, on-chip memory is typically 
organized using power of two boundaries and addressing. Thus, non-power of two instruction sets, such as 
shown in the instruction format 204 (i.e., a forty bit or five byte instruction), are not necessarily aligned when 
stored in instruction cache unit 106. 

FIG. 3 is a block diagram of an instruction queue 302 and instruction fetch unit 108 shown in greater 
detail in accordance with one embodiment of the present invention. Instruction fetch unit 108 is connected to 
instruction cache unit 106 via a conventional 32-byte data path. Instruction fetch unit 108 includes a prefetch 
unit 304. Prefetch unit 304 includes dual in-line buffers 306. Dual in-line buffers 306 are implemented as, for 
example, two 32-byte wide registers. Dual in-line buffers 306 store two sequential lines of instructions fetched 
from instruction cache unit 106. By storing two sequential lines of instructions fetched from instruction cache 
unit 106, instruction fetch unit 108 essentially ensures that the subsequent instruction is stored in dual in-line 
buffers 306, regardless of whether or not it represents a non-aligned instruction (e.g., the instruction spans two 
lines in instruction cache unit 106). Thus, instruction fetch unit 108 solves the problem of having to request two 
instruction fetches from instruction cache unit 106, which typically causes a waste of at least one clock cycle of 
the microprocessor. 

Instruction fetch unit 108 also includes an instruction aligner 308. Instruction aligner 308 extracts and 
aligns the non-power of two size instruction from instruction data stored in dual in-line buffers 306. For 
example, for a 40-bit instruction, instruction aligner 308 extracts the 40-bit instruction from the 64 bytes of data 
stored in dual in-line buffers 306. Instruction aligner 308 then efficiently aligns the 40-bit instruction, as further 
discussed below. 

in one embodiment, microprocessor 1 00 includes four processors or CPUs (Central Processing Units). 
Microprocessor 100 executes up to four instructions per cycle. Instruction fetch unit 108 provides up to four 
instructions per cycle to instruction queue 302 to maintain the peak execution rate of four instructions per cycle. 
For example, for a 40-bit instruction set, which defines 40-bit instruction sizes, instruction fetch unit 108 



00331 79A2 J > 



WO 00/33179 



PCT/US99/28872 



-6- 



10 



15 



20 



25 



provides up to 160 bits per cycle in order to provide four instructions per cycle. Thus, instruction fetch un.t 
provides up to 20-bytes of instruction data (e.g., a 20-byte VLIW packet) to instruction queue 302 per cycle. 
Because dual in-line buffers 306 store 64 bytes of instruction data, instruction aligner 308 is response for 
extracting and appropriately aligning, for example, the 20 bytes of instruction data for the next cycle that ,s 
within the 64 bytes of instruction data stored in dual in-line buffers 306. Accordingly, in one embodnnent, an 
efficient method for fetching instructions having a non-power of two size is provided. 

FIG 4 is a functional diagram of instruction cache unit 106 connected to instruction fetch unit 108 in 
accordance with one embodiment of the present invention. A cache line 402 that includes 32 bytes of instruct™ 
data stored in instruction cache unit 106 is sent to instruction fetch unit 108 via a 32-byte data path 40<L 
instruction fetch unit 108 includes dual in-line buffers 306. Dual in-line buffers 306 include a line buffer 0 that 
is 32-bytes wide and a line buffer 1 that is 32-bytes wide. For example, line buffer 0 and line buffer 1 can be 
Elemented as registers of instruction fetch unit ,08, or line buffer 0 and line buffer 1 of dual in-line buffers 
306 can be implemented as two sets of enab.e-reset flip-flops, in which the flip-flops can be stacked (two m one 
bit slice) The 32-bytes of data are then extracted from dual in-line buffers 306 and transmitted vta a 32-byte 
data path 406 to instruction aligner 308. Instruction aligner 308 extracts and aligns the instruction (e.g., 10 bytes 
of instruction data) from the 32 bytes of instruction data and then transmits the extracted and aligned mstn.ct.on 
for appropriate execution on processors 1 10 and 1 12 of microprocessor 100. 

Dual in-line buffers 306 maintain two sequential lines of instruction data fetched from instruction cache 
unit 106. After the instruction data is extracted from dual in-line buffers 306, instruction fetch un.t 108 fetches 
the next sequential line of instruction data for storage in dual in-line buffers 306. For example, based on the 
address of the fetched data (e.g., if the fifth address bit is zero, then the fetched data is loaded into line buffer 0, 
else the fetched data is loaded into line buffer 1), either line buffer 0 or line buffer 1 is purged, and the next 
sequential line of cache memory (e.g., cache line 402 of instruction cache unit 106) is fetched and stored m the 
now purged line buffer 0 or line buffer 1 . In steady state mode, instruction fetch unit 108 maintains a rate of 
fetching of 32 bytes of instruction data per cycle. Because only up to 20 bytes of instruction data are consumed 
per cycle in the 20-byte VLIW packet example, and instruction data is stored in memory sequentially, mstruct.on 
fetch unit ,08 can generally satisfy the peak execution rate of microprocessor 100, such as 20 bytes of instructs 
data or four instructions per multi-processor cycle of microprocessor 100. 

The instruction data path within instruction fetch unit 108 involves, for example, selecting a 20-byte 
wide byte-aligned field from 64 bytes of data stored in dual in-line buffers 306. The 20-byte wide byte-ahgned 
field is buffered (e.g., stored in instruction queue 302) and then appropriately presented to the CPUs (e.g., 4 
different processors). For a 20-byte VLIW packet, the data path size between instruction cache un.t 106 and 
instruction fetch unit 108 can be 32 bytes, because the cache line size is 32 bytes. 
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However, extracting a 20-byte wide byte-aligned field from 64 bytes of non-aligned instruction data 
efficiently represents a challenging problem. Accordingly, instruction fetch unit 108 efficiently performs a rotate 
and truncate (RAT) of a 20-byte wide byte-aligned field from 64 bytes of non-aligned instruction data, in which, 
for example, 20 bytes is the maximum size of a VLIW packet, and 64 bytes of instruction data is prefetched from 
instruction cache unit 106 in accordance with one embodiment of the present invention, as further discussed 
below. 

FIG. 5 is a diagram of possible 5-byte instruction positions within a 32-byte wide cache memory. Each 
32-byte aligned location is called a cache memory line. An instruction can be located in 32 unique positions in 
the five cache memory lines (e.g., cache memory lines 0-5) before the position sequence of FIG. 5 repeats. 

In one embodiment, instruction aligner 308 can select an instruction from any one of these 32 different 
positions along with 0-3 subsequent instructions (assuming a VLIW packet that includes up to four instructions). 
In order to accomplish this task, instruction aligner 308 uses a 5-bit offset pointer indicating where in the 32-byte 
data path the first byte of the General Functional Unit (GFU) instruction is found for a multiprocessor that 
includes, for example, four different processors such as the GFU and three Media Functional Units (MFUs). 
instruction aligner 308 then left justifies the first byte along with up to 19 subsequent bytes to provide the 
instruction packet (e.g., the VLIW packet). If the instruction packet spans (i.e., crosses) a cache memory line 
boundary, then instruction aligner 308 combines the contents of line buffer 0 and line buffer 1 of dual in-line 
buffers 306. 

FIG. 6 is a functional diagram of the operation of instruction fetch unit 108 of FIG. 4 shown in greater 
detail in accordance with one embodiment of the present invention. Each quarter of a line buffer (e.g., line buffer 
0 and line buffer 1 of dual in-line buffers 306) includes 8 bytes, or two words, which together represent a double 
word. Thus, each line buffer includes four double words, which together make up an octword. The first double 
word in the line buffer is numbered 0, followed by 1, 2, and 3, respectively. Line buffer 0 (e.g., line buffer 0 of 
dual in-line buffers 306) holds even octwords, because it includes memory lines at even octword addresses (e.g., 
0, 64, and 128). Line buffer 1 (e.g., line buffer 1 of dual in-line buffers 306) holds odd octwords, because it 
includes memory lines at odd octword addresses (e.g., 32, 96, and 160). Instruction fetch unit 108 includes four 
2:1 doubleword muxes to concatenate any four doublewords stored in line buffer 0 and line buffer 1. Four 
doublewords (32 bytes) provide the data needed to extract a 20-byte instruction such as a VLIW packet, which is 
a maximum of 20 bytes (assuming both of the line buffers include valid data). 

In one embodiment, the instruction data path is implemented as an instruction data path megacell that 
includes the following: dual in-line buffers 306 that hold two cache lines (64 bytes in total) fetched from 
instruction cache unit 106, doubleword muxes 602, 604, 606, and 608 that select 32 bytes of instruction data 
from dual in-line buffers 306 to provide aligner input 610, rotate and truncate logic (RAT) unit 61 1 of instruction 
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aligner 308 that selects a VLIW packet by left justifying and truncating the 32 bytes presented by the double 
word muxes to provide RAT output 612. 

Specifically, FIG. 6 shows an example of a four instruction VLIW packet starting at byte 15 of line 
buffer 0 of dual in-line buffers 306 and ending at byte 2 of line buffer 1 of dual in-line buffers 306. The VLIW 
packet passes through mux input 0 of doubleword muxes 1 (604), 2 (606), and 3 (608), and mux input 1 of 
doubleword mux 0 (602). The result is a 32-byte aligner input 610 that includes instructions 3, 4, 5, and 6, wh.ch 
represent a VLIW packet. Doubleword muxes 602, 604, 606, and 608 represent the first level of muxes that 
select all the doublewords necessary to obtain the minimal power of two size aligned super set of the desired 
VLIW packet (e.g., selects 32 bytes of instruction data that include the 20-byte VLIW packet). Aligner input 610 
is provided to RAT unit 61 1 of instruction aligner 308. RAT unit 61 1 performs a RAT function that extracts and 
aligns the 20-byte VLIW packet from 32-byte aligner input 610 and, in particular, rotates and truncates the 32 
bytes of instruction data in order to output 20 bytes of instruction data as RAT output 6 1 2 that represents a byte- 
aligned VLIW packet. 

Referring to the selection of bytes of instruction data stored in dual in-line buffers 306, the selection is 
performed by using the known start address of the VLIW packet, and then extracting the next sequential bytes 
using doubleword muxes 602, 604, 606, and 608 to provide 32-byte aligner input 610. For example, a VLIW 
packet can be 5, 10, 15, or 20 bytes (e.g., it depends on whether or not the compiler generated 1 , 2, 3, or 4 
instructions in parallel, that is, for execution in a single cycle on the multi-processor), in which the first two bits 
of the VLIW packet represent a packet header that indicates how many instructions are included in the VLIW 
packet. Thus, when a VLIW packet is decoded, it can be determined that only 10 bytes of instruction data are 
needed (e.g., two instructions were compiled for execution in parallel in a particular cycle). 

Aligner input 610 represents 32 bytes of instruction data within which resides up to 20 bytes of non- 
aligned VLIW data. RAT unit 61 1 performs a RAT operation that extracts and aligns non-power of two size 
instruction data from the power of two size instruction data (e.g., a 20-byte VLIW packet from 32 bytes of 
aligner input 610) to provide RAT output 612. The RAT operation can be implemented using twenty 32:1 muxes 
using two levels of muxes, eight 4:1 muxes, each of which connects to an 8:1 mux to effectively provide a 32:1 
mux, which represents a brute force approach. However, a more efficient approach is discussed below. 

FIG. 7 is a functional diagram of a multi-level implementation of instruction aligner 308 in accordance 
with one embodiment of the present invention. In particular, instruction aligner 308 is implemented using two 
levels of muxes, which includes a first level mux select 802 and a second level mux select 804. The first level of 
muxes includes eight 4:1 byte-wide muxes. The second level of muxes includes an 8:1 byte-wide mux. 
Logically, there is a two-level mux structure for each bit of the 20 bytes input to instruction aligner 308. Mux 
select controls 802 and 804 are updated every cycle in order to sustain alignment of one VLIW packet per cycle. 
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For example, instruction aligner 308 can be implemented as a megace.l that is organized wkh a stacked bit cel. 
placement. 

FIG. 8 is a block diagram of dual in-line buffers 306 connected to double word muxes 602, 604, 606, 
and 608 shown in greater detail in accordance with one embodiment of the present invention. Doubleword 
muxes 602, 604, 606, and 608 select 32 bytes out of the 64 bytes stored in dual in-line buffers 306, which include 
line buffer 0 (32 bytes) and line buffer 1 (32 bytes). The 32 bytes of data selected by doubleword muxes 602, 
604 606, and 608 are then transmitted to RAT unit 61 1 of the instruction data path as discussed above with 
respect to FIG. 6. Doubleword muxes 602, 604, 606, and 608 are essentially 2: 1 muxes that select a doubleword 
(8 bytes) from either line buffer 0 (even octword) or line buffer 1 (odd octword). Doubleword muxes 602, 604, 
606, and 608 are used to take advantage of the fact that at most 20 bytes of the 32 bytes of instruction data will 
be used. The granularity of the muxes may be set to any size down to single-byte granularity. The doubleword 
granularity is chosen based upon simplification of truth tables as shown in Table 1 and Table 2 in accordance 
with one embodiment of the present invention. 

FIG. 9 is a functional diagram of the operation of RAT unit 61 1 shown in greater detail in accordance 
with one embodiment of the present invention. In particular, RAT unit 61 1 includes a RAT megacell 702. RAT 
megacell 702 performs the functionality of twenty 32:1 byte-wide muxes. The inputs to each of the 32:1 muxes 
come from the outputs of doubleword muxes 602, 604, 606, and 608. The inputs to doubleword muxes 602, 604, 
606 and 608 come from line buffer 0 and line buffer 1 of dual in-line buffers 306. The byte positions in the hue 
buffersOand 1 are labeled [0A...0Z, 0a...0f] for line buffer 0 and [1 A... 1Z, la...lfj for line buffer 1. The inputs 
to each consecutive 32: 1 mux in RAT megacell 702 are identical to the previous mux, except the ordering .s 
rotated to the left by one byte. Accordingly, this can simplify the RAT megacell implementation as follows: 
inputs to each mux can be routed identically, and the 32-byte mux select bus can be rotated one position for each 
mux, mux #0 (704), mux #1 (706), and mux #19 (708). If the correct double words are provided to RAT 
megacell 702, then only one set of decode logic is needed to specify the shift amount. The rotated and truncated 
25 output from RAT unit 6 1 1 is transmitted to instruction queue 302. 

FIG. 10 is a functional diagram of a symbolic implementation of RAT unit 61 1 in accordance with one 
embodiment of the present invention. RAT unit 61 1 receives the 32 bytes of instruction data presented by 
doubleword muxes 602, 604, 606, and 608 and performs a rotation to left justify the byte at the address offset. 
RAT unit 61 1 then truncates the instruction data to provide, for example, a 20-byte VLIW packet. Thus, RAT 
30 unit 611 essentially implements the functionality of a 32:1 mux. The primary function is to map any one of 32 
bytes to, for example, each one of the 20 bytes in a 20-byte VLIW packet. Because a 32:1 mux is expensive 
from a floor planning and circuit implementation standpoint, RAT unit 61 1 is implemented as a two-level 32:1 
mux in accordance with one embodiment of the present invention. A first level 1002 includes eight 4:1 muxes 
for every bit of the aligner input. A second level 1004 includes one 8:1 mux for every bit of the aligner input. 
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However, by recognizing that all the inputs are the same for bit „ of each byte of bytes 0-19 (assummg a 
20-byte VLIW packet), some combining of bits is possible to reduce wiring in the RAT implements. 
Accordingly, in one embodiment, the muxes for bit n for 4 bytes are grouped together. The bit ordering of the 
first few bits is discussed below with respect to FIG. 1 1. Because the bits of the VL.W packet are produced out 

5 of order, an additional routing channel is used to "re-order" the bits. The grouping size of 4 bytes means that the 
chaxmel must be wide enough to re-order 32 bits (e.g., a routing overhead of approximately 50-60 urn). In each 
4-byte wide grouping (bit n for 4 bytes), two levels of muxes can be used to implement the 32:1 mux for each b,t. 
Ordering of the inputs to the eight 4:1 muxes in generation of the selects (select or control signals) allows the 
same eight 4:1 muxes to be used for each bit. Thus, eight 4:1 muxes and four 8:1 muxes are used for every 4 

,0 bits, instead of eight 4:1 and one 8:1 mux for every bit, which results in a reduction of muxes from .440 (9x160) 
to 480 (12x40). 

FIG 1 1 is a functional diagram of a RAT bit ordering in accordance with one embodiment of the 
present invention. Because 32 inputs span across 4 bits instead of 1 , the bit slice pitch can be reduced by usmg 
the RAT bit ordering as shown in FIG. 11. For example, a 14.34 urn (microns) pitch can be used instead of a 25 
,5 urn pitch, which translates into a savings of about 750 urn in the width of the instruction data path. 

FIG 12 is a functional diagram of a RAT physical implementation in accordance with one embodiment 
of the present invention. The input to the RAT physical implementation of FIG. 12 is the same or ident.cal for 
each of the eight 4:1 muxes. By recognizing that each of the inputs to the eight 4:1 muxes are the same (,.e the 
same 32 bytes of data), each of the eight 4: 1 muxes can be implemented as shown in a block 1204. Block 1204 
20 showseight4:l muxes (A, B, C, D, E, F, G, and H) and four 8: 1 muxes(0, l,2,and3). Each of the eight ^4: 
m uxes is set or control.ed in order to output a particular bit n of each selected byte. For example, block 1204 
outputs bit 7 of a 4-byte group 1202, and thus, block ,204 outputs bit 7 of bytes 0, 1, 2, and 3, which represents 
an output of bit 159, bit 151, bit 143, and bit ,35. The output is then sent to a channel 1206, which reorders the 
bits into descending order. For example, assuming 20 bytes of instruction data, such as a 20-byte VLIW packet, 
25 channel 1206 reorders the 160 bits or 20 bytes of data from bit number 159 in descending order to bn number 0. 
Because not al, of the outputs of the eight 4:1 muxes are necessarily selected, "do not care" conditions can be 
provided in the mux selection or control logic. Thus, this embodiment enables some combination of the 4:1 mux 
selects. A truth table for the mux select control signals is shown in Tables 3-6 in accordance w.th one 
embodiment of the present invention. Further, the controls of the muxes are generated based upon the offset „ 
30 the address offset register (not shown). The controls for each 4:1 mux (muxes A, B, C, D, E, F, G, and H) an 
each 8:, mux (0, 1, 2, and 3) can be shared across the entire RAT unit if the bits are ordered carefully. 

FIG. 13 is a functional diagram of an input byte ordering for each 4-byte group that allows the mux's 
select control signals to be shared in accordance with one embodiment of the present invention. For example, for 
bytes 0-3 (B0-B3), 8:1 mux A selects bits 0-7 from bytes 0, 8, 16, and 24, 8:1 mux B selects bits 0-7 from bytes 
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1,9, 17 and 25, and 8:1 mux H selects bits 0-7 from bytes 7, 1 5, 23, and 3 1 . Accordingly, the input byte 
ordering for each four-byte group advantageously allows the mux selects to be shared as discussed above. 

FIG. 14 is a block diagram of instruction queue 302 shown in greater detail in accordance with one 
embodiment of the present invention. Instruction queue 302 is a four-entry instruction queue that provides a 

5 decoupling buffer between instruction fetch unit 108 and processors 1 10 and 1 12. As discussed above, every 
cycle, instruction fetch unit 108 provides an instruction packet (e.g., a VLIW packet). The instruction packet is 
passed onto the processors for execution if the processors are ready for a new instruction. For example, in two 
cases, a VLIW packet is produced that cannot be executed immediately. First, if the execution pipeline is stalled 
(e.g., for load dependency), then the VLIW packet is written to instruction queue 302. Second, when a pair of 

10 instructions for a particular processor such as the GFU is present, only one GFU instruction can be executed, and 
the other GFU instruction is queued in instruction queue 302. When the instruction fetch pipeline is stalled due 
to an instruction cache miss, for example, some of the penalty for the instruction fetch pipeline stall can be 
hidden by having valid entries buffered in instruction queue 302. 

Instruction queue 302 is a four-entry FIFO (First In First Out) queue that can be implemented as a static 
15 register file. Control logic in instruction fetch unit 108 can provide FIFO pointers. The tail entry of instruction 
queue 302 can be written with either RAT unit 6 1 1 or the second instruction of a GFU pair (e.g., RAT_OUT 
[1 19:80]). A read can be implemented using a 4:1 mux in instruction queue 302. Thus, bits 159-120 of 
instruction queue 302 can be written with either the second instruction of a GFU pair or the output of RAT unit 
611. The rest of the bits (i.e., bits 1 19:0) can be written with the output of RAT unit 611. 

20 Although particular embodiments of the present invention have been shown and described, it will be 

obvious to those skilled in the art that changes and modifications can be made without departing from the present 
invention in its broader aspects, and therefore, the appended claims are to encompass within their scope all such 
changes and modifications that fall within the true scope of the present invention. 



BNSDOCID: <WO 00331 79A2_f_> 



WO 00/33179 



PCT/US99/28872 



- 12- 



TABLE 1 



Doubleword Mux Selects 







MUX A 




1Y1UA J-> 




Mux C 




MuxD 


Sell 


Byte Offsets 


{PC[5] AOR[4:2]} 


SelO 


oen 


oeiu 


OCI 1 


SelO 


Sell 


SelO 


0-3 


0000 


1 


0 


1 


0 


J 




x 

A 


x 


4-7 


0001 


i 
i 


o 


1 


0 




0 




0 
0 


8-11 


0010 


X 


X 


1 


0 




0 




12-15 


0011 


0 




1 


0 




0 




0 


16-19 


0100 


0 




X 


X 




0 




0 
0 


20-23 
24-27 


0101 
0110 


0 
0 




0 
0 




X 


0 
X 




0 
0 


28-31 
32-35 


0111 
1000 


0 
0 




0 
0 




0 
0 




X 


X 


36-39 


1001 


0 




0 




0 




0 




40-43 


1010 


X 


X 


0 




0 




0 




44-47 


1011 


1 


0 


0 




0 




0 




48-51 


1100 


1 


0 


X 


X 


0 




0 




52-55 


1101 


1 


0 


1 


0 


0 


X 


0 




56-59 


1110 


1 


0 


1 


0 


X 


0 




60-63 


1111 


1 


0 


1 


0 


1 


0 


0 





TABLE 2 



Optimized Doubleword Mux Selects 







Mux A 




MuxB 


Byte Offsets 


{PC[5],AOR[4:3]} 


SelO 


Sell 


SelO 


0-7 


000 


1 


0 


1 


8-15 


001 


0 


1 


1 


16-23 


010 


0 


1 


0 


24-31 


011 


0 


1 


0 


32-39 


100 


0 


1 


0 


40-47 


101 


1 


0 


0 


48-55 


no 


1 


0 


1 


56-63 


111 


1 


0 


1 



Sell 



MuxC 
SelO Sell 



MuxD 
SelO Sell 



1 
1 
1 

0 
0 
0 
0 

1 



0 
0 
0 

1 
1 
1 
1 

0 



1 
1 
1 
1 

0 
0 
0 
0 



0 
0 
0 
0 

1 

1 
1 
1 



The equations for the doubleword mux selects based upon the optimization are as follows: 

Mux A, SelO = (!PC[5] && !AOR[4] && ! AOR[3]) II <PC[5] && AOR[4» || (PC[5] m&& AORJ3]) 
Sell = (PC[5] && !AOR[4] && !AOR[3]) II (IPC[5J && AOR[4]) || (!PC[5] && AOR[3]) 

Mux B, SelO = (!PC[5] && !AOR[4]) || (PC[5] && AOR[4]) 
Sell = (!PC[5] && AOR [4]) || (PC[5] && !AOR[4]) 
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TABLE 3 



M„v r SelO = fPCm && AOR[4] && AOR[3]) || (!PC[5] && !AOR [4]) || (!PC[5] && !AOR[3]) 
Mux C, SelO JW^AOR^ ^ && ^ II j ^ && ^ ^ ( ^ && , AOR[3]) 

Mux D, SelO = !PC[5] 
Sell=PC[5] 
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TABLE 4 



1 



AOR 

00000 

00001 

00010 

00011 

00100 

00101 

00110 

00111 

01000 

01001 

01010 

01011 

01100 

01101 

01110 

01111 

10000 

10001 

10010 

10011 

10100 

10101 

10110 

10111 

11000 

11001 

11010 

11011 

11100 

11101 

11110 

11111 



Mux E 
0 1 



Mux F 
0 1 



Mux G 
0 1 



MuxH 
0 1 



2 3 



0 
1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

21 

22 

23 

24 

25 

26 

27 

28 

29 

30 

31 



X 

1 

1 

1 

1 

X 

X 

X 

X 

0 

0 

0 

0 

X 

X 

X 

X 

0 

0 

0 

0 

X 

X 

X 

X 

0 

0 

0 

0 

X 

X 

X 



X 

0 

0 

0 

0 

X 

X 

X 

X 

1 
1 
1 
1 

X 

X 

X 

X 

0 

0 

0 

0 

X 

X 

X 

X 

0 

0 

0 

0 

X 

X 

X 



X 

0 

0 

0 

0 

X 

X 

X 

X 

0 

0 

0 

0 

X 

X 

X 

X 

] 
1 
1 
1 

X 
X 
X 
X 
0 
0 
0 
0 
X 
X 
X 



X 

0 

0 

0 

0 

X 

X 

X 

X 

0 

0 

0 

0 

X 

X 

X 

X 

0 

0 

0 

0 

X 

X 

X 

X 

1 
1 
1 
1 

X 
X 
X 



X 
X 

1 
1 
1 
1 

X 

X 

X 

X 

0 

0 

0 

0 

X 

X 

X 

X 

0 

0 

0 

0 

X 

X 

X 

X 

0 

0 

0 

0 

X 

X 



X 
X 
0 
0 
0 
0 
X 
X 
X 
X 

1 
1 
1 
1 

X 

X 

X 

X 

0 

0 

0 

0 

X 

X 

X 

X 

0 

0 

0 

0 

X 

X 



X 

X 

0 

0 

0 

0 

X 

X 

X 

X 

0 

0 

0 

0 

X 

X 

X 

X 

1 
1 

1 
1 

X 
X 
X 
X 
0 
0 
0 
0 
X 
X 



X 

X 

0 

0 

0 

0 

X 

X 

X 

X 

0 

0 

0 

0 

X 

X 

X 

X 

0 

0 

0 

0 

X 

X 

X 

X 

1 
1 
1 
1 

X 
X 



X 
X 
X 

1 
1 
1 
1 

X 

X 

X 

X 

0 

0 

0 

0 

X 

X 

X 

X 

0 

0 

0 

0 

X 

X 

X 

X 

0 

0 

0 

0 

X 



X 
X 
X 
0 
0 
0 
0 
X 
X 
X 
X 

1 
1 
1 
1 

X 

X 

X 

X 

0 

0 

0 

0 

X 

X 

X 

X 

0 

0 

0 

0 

X 



X 

X 

X 

0 

0 

0 

0 

X 

X 

X 

X 

0 

0 

0 

0 

X 

X 

X 

X 

1 
1 
1 
1 

X 
X 
X 
X 
0 
0 
0 
0 
X 



X 

X 

X 

0 

0 

0 

0 

X 

X 

X 

X 

0 

0 

0 

0 

X 

X 

X 

X 

0 

0 

0 

0 

X 

X 

X 

X 

1 
1 
1 
1 

X 



X 
X 
X 
X 

1 
1 
1 
1 

X 

X 

X 

X 

0 

0 

0 

0 

X 

X 

X 

X 

0 

0 

0 

0 

X 

X 

X 

X 

0 

0 

0 

0 



X 

X 

X 

X 

0 

0 

0 

0 

X 

X 

X 

X 

1 
1 
1 
1 

X 

X 

X 

X 

0 

0 

0 

0 

X 

X 

X 

X 

0 

0 

0 

0 



X 

X 

X 

X 

0 

0 

0 

0 

X 

X 

X 

X 

0 

0 

0 

0 

X 

X 

X 

X 

1 

1 

! 

1 

X 
X 
X 
X 
0 
0 
0 
0 



X 

X 

X 

X 

0 

0 

0 

0 

X 

X 

X 

X 

0 

0 

0 

0 

X 

X 

X 

X 

0 

0 

0 

0 

X 

X 

X 

X 

1 

1 
1 
1 
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TABLE 5 



AOR 


Muxes A-D 
0 1 2 


3 


o 


Muxes E-H 
1 2 


3 


00000 


0 


1 


0 


0 


0 


J 


0 


0 


0 


00001 


1 


1 


0 


0 


0 


J 


0 


0 


A 
\J 


00010 


2 


1 


0 


0 


0 




0 


0 


o 

u 


00011 


3 


1 


0 


0 


0 


1 


0 


0 


n 

V 


00100 


4 


0 


1 


0 


0 


1 


0 


0 


A 

u 


00101 


5 


0 


1 


0 


0 


1 


0 


0 


A 

u 


00110 


6 


0 


1 


0 


0 


1 


0 


0 


A 

u 


00111 


7 


0 


1 


0 


0 




0 


0 


A 

u 


01000 


8 


0 


1 


0 


0 


0 


1 


0 


A 

u 


01001 


9 


0 


1 


0 


0 


0 


1 


0 


A 

u 


01010 


10 


0 


1 


0 


0 


0 


1 


0 


A 

u 


01011 


11 


0 


1 


0 


0 


0 


1 


0 


A 


01100 


12 


0 


0 


1 


0 


0 


1 


0 


A 

u 


01101 


13 


0 


0 


1 


0 


0 


1 


0 


A 

u 


onio 


14 


0 


0 


1 


0 


0 


1 


0 


A 


01111 


15 


0 


0 


1 


0 


0 


1 


0 


0 


10000 


16 


0 


0 


1 


0 


0 


0 


1 


A 

0 


10001 


17 


0 


0 


1 


0 


0 


0 


1 


A 

u 


10010 


18 


0 


0 




0 


0 


0 




A 

u 


10011 


19 


0 


0 




0 


0 


0 




A 


10100 


20 


0 


0 


0 




o 


0 




0 


10101 


21 


0 


0 


0 




0 


0 




0 


10110 


22 


0 


0 


0 




0 


0 




0 


10111 


23 


0 


0 


0 




0 


0 




0 


11000 


24 


0 


0 


0 




0 


0 


0 




11001 


25 


0 


0 


0 




0 


0 


0 




11010 


26 


0 


0 


0 




0 


0 


0 




11011 


27 


0 


0 


0 




0 


0 


0 




11100 


28 


1 


0 


0 


0 


0 


0 


0 




11101 


29 


1 


0 


0 


0 


0 


0 


0 




11110 


30 


1 


0 


0 


0 


0 


0 


0 




11111 


31 


1 


0 


0 


0 


0 


0 


0 
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The logic equations for the mux selects of the 4: 1 muxes are as follows: 

M,,*~ A D SelO = ( 'AORMl && !AOR[3] && !AOR[2]) II (AOR[4] && AOR[3] && AOR[2]) 
Muxes A DM) ;A°™£ , AOR[3] && AOR[2]) II (! AOR[4] && AOR[31 && I AOR[2]) 
Sel2 = (!AOR[4] && AOR[3] && A0R[2]) II (AOR[4] && !AOR[3] &&. AORJ2]) 
Sel3 = (AOR[4] && !AOR[3] && AOR[2]) II (AOR[4] && AOR[3J && !AOR(2]) 

Muxes E-H, SelO = !AOR[4] && !AOR[3] 
Sell = !AOR[4] && AOR[3] 
Sel2 = AOR[4] && !AOR[3] 
Sel3 = AOR[4] && AOR[3] 

The 8- 1 mux control is much simpler as a result of the routing of the 4: 1 mux outputs . c . 

TOs rou^g can be seen in Figure 9. The logic equations for the mux selects of the 8:1 muxes are as follows. 

Muxes 0-3, SelO = !AOR[2] && !AOR[l] && !AOR[0] 
Sell = !AOR[2] && !AOR(l] && AOR[0] 
Sel2 = !AOR[2] && AOR[l] && !AOR[0] 
Sel3 = ! AOR[2] && AOR[ 1 ] && AOR[0] 
SeI4 = AOR[2] && !AOR[l] && !AOR[0] 
Sel5 = AOR[2] && !AOR[l] && AOR[0] 
Sel6 = AOR[2] && AOR[l] && !AOR[0] 
Sel7 = AOR[2] && AOR[l] && AOR[0] 
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WE CLAIM 

! 1 . A method for fetching instructions having a non-power of two size, comprising: 

2 fetching at least two sequential lines of instruction data having a power of two size from an instruction 

3 cache unit for storage in dual in-line buffers of an instruction fetch unit; and 

4 extracting and aligning a non-power of two size instruction that is stored in the dual in-line buffers. 

1 2. The method of Claim 1 further comprising: 

2 storing a first instruction cache line having a power of two size in a first line buffer of the dual in-line 

3 buffers; and 

4 storing a second instruction cache line having a power of two size in a second line buffer of the dual in- 

5 line buffers, wherein the non-power of two size instruction spans the first instruction cache line 

6 and the second instruction cache line. 

1 3. The method of Claim 1 further comprising: 

2 storing an instruction cache line in an instruction cache unit, wherein the stored instruction cache line is 

3 power of two size-aligned. 

1 4. The method of Claim 3 further comprising: 

2 transmitting power of two size instruction cache data that is extracted from the dual in-line buffers to an 

3 instruction aligner. 

1 5. The method of Claim 4 further comprising: 

2 rotating and truncating the non-power of two size instruction from the power of two size instruction 

3 cache data using a rotate and truncate (RAT) unit of the instruction aligner. 

1 6. The method of Claim 5 further comprising: 

2 transmitting the non-power of two size instruction to an instruction queue for buffering before executioi 

3 of the non-power of two size instruction. 

1 7. The method of Claim 3 wherein the instruction cache line comprises 32 bytes of data. 

1 8. The method of Claim 1 wherein the non-power of two size instruction comprises a Very Long 

2 Instruction Word (VLIW) packet. 
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, 9. The method of Claim 1 wherein the non-power of two size instruction comprises a 5-byte, 10- 
2 byte, 1 5-byte, or 20-byte instruction packet. 

1 1 0. The method of Claim 9 wherein the non-power of two size instruction comprises a packet 

2 header, the packet header indicating the number of instructions in the instruction packet. 

! 1 1 . A method for fetching instructions having a non-power of two size, comprising: 

2 fetching a first instruction cache line having a power of two size for storage in a first line buffer of dual 

3 in-line buffers of an instruction fetch unit of a microprocessor; 

4 fetching a second instruction cache line having a power of two size for storage in a second line buffer of 

5 the dual in-line buffers; and 

6 extracting a non-power of two size instruction that is stored in the dual in-line buffers. 

1 12. The method of Claim 1 1 further comprising: 

2 aligning the non-power of two size instruction, wherein the extracting and aligning is performed in a 

3 single clock cycle of the microprocessor. 

1 13. The method of Claim 1 2 further comprising: 

2 storing a power of two size instruction cache line in an instruction cache unit. 

1 14. The method of Claim 13 further comprising: 

2 transmitting power of two size instruction cache data that is extracted from the dual in-line buffers to an 

3 instruction aligner. 

1 15. The method of Claim 14 further comprising: 

2 rotating and truncating the non-power of two size instruction from the power of two size instruction 

3 cache data using a rotate and truncate (RAT) unit of the instruction aligner. 

1 1 6. The method of Claim 1 5 further comprising: 

2 transmitting the non-power of two size instruction to an instruction queue for buffering before execution 

3 of the non-power of two size instruction. 

1 1 7. The method of Claim 1 3 wherein the instruction cache line comprises 32 bytes of data. 

1 18. The method of Claim 1 1 wherein the non-power of two size instruction comprises a Very Long 

2 Instruction Word (VLIW) packet. 
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1 19. The method of Claim 1 1 wherein the non-power of two size instruction comprises a 5-byte, 

2 byte, 1 5-byte, or 20-byte instruction packet. 

1 20. The method of Claim 1 9 wherein the non-power of two size instruction comprises a packet 

2 header, the packet header indicating the number of instructions in the instruction packet. 
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